Skip to content

EvidenceBench v4 research release#3

Merged
blankey1337 merged 8 commits into
mainfrom
codex/evidencebench-v4
Jul 25, 2026
Merged

EvidenceBench v4 research release#3
blankey1337 merged 8 commits into
mainfrom
codex/evidencebench-v4

Conversation

@blankey1337

Copy link
Copy Markdown
Member

Summary

  • adds the two-track EvidenceBench v4 evaluator and reproducible research protocol
  • documents lessons from Harvey LAB and the validation/release gates
  • publishes a safe aggregate-only four-model snapshot
  • adds a public professional-review contribution path

Validation

  • 37 Python tests pass
  • sealed 240-item Doctrine and 60-task Matter corpus validated in the private control repository
  • no item-level holdout fields in the public snapshot
  • OpenRouter account delta: $90.84, below the $100 ceiling

This is explicitly an unreviewed research release, not an official or attorney-validated leaderboard.

@blankey1337
blankey1337 merged commit 29f5495 into main Jul 25, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants